Searchin^p^AJ 



http7/www19jpdlopo.gojp/PA1/result/detail/main/wAAAW.aGFWDM082493^ 



PATENT ABSTRACTS OF JAPAN 

( 1 1 )Publication number : 08-249349 
(43)Date of publication of application : 27.09.1996 



(51)Int.CL 



G06F 17/30 



(2 l)Application number : 07-054794 
(22)Date of filing : 14.03.1995 



(71) Applicant : 

(72) Inventor : 



SAKAUCHI MASAO 
SHARP CORP 
SAKAUCHI MASAO 
ONO ATSUSHI 



(54) IMAGE DATA BASE DEVICE 

(57)Abstract: 

PURPOSE: To provide a versatile image data base device by enabling automatic extraction 
from an image by using a concept of higher level as a key word and lightening the operation 
burden at the time of registration, and enabling even an image which does not match with a 
state transition model to be registered and retrieved. 

CONSTITUTION: The image data base device divides an input image inputted by an image 
input part 1 into segments, converts an image feature quantity of each segment calculated by an 
image feature quantity calculation part 7 into a scene description language by a scene 
description language conversion part 8, shifts the scene description language of each segment 
to a concept of stratum as high as possible by a state transition part 1 0 on the basis of the state 
transition model, and registers the final state of each segment and the scene description 
language of a segment having no state transition as key words in an image data base 11 by a 
data registration part 12 together with the input image. 
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♦ NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by conqjuter. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. hi the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] this invention accumulates image information in large quantities, and relates to the image database 
equipment which carries out automatic extracting of the keyword from a picture especially in the case of registration of a picture 
about the image database equipment with which a picture can be searched by giving a keyword. 
[0002] 

[Description of the Prior Art] The expectation for the image database equipment for searching a required picture efficiently from 
the image information accxunulated in large quantities in recent years is growing. Although the image database equipment with 
which the picture corresponding to this keyword is extracted is known if a registrant registers simultaneously the keyword which 
is the semantic information on the picture by manual input and a keyword is inputted by the reference person at the time of 
reference in case a picture is registered conventionally Since it is not efficient that a registrant inputs a keyword manually to all 
pictures, the various attempts for performing automatic extracting of a keyword from a picture are made using an image 
recognition or image comprehension technology. 

[0003] As such an attempt, for exan^le, the image database equipment with which (1) reference person inputs a sensibility word 
and the picture corresponding to the sensibility word is searched (refer to a "picture reference which was adapted for degree of 
subjective similar": Information Processing Society of Japan paper magazine, Vol.31, and no.2 (1990)), (2) The image database 
equipment (73 to "image database in consideration of keyword automatic extracting": Information Processing Society of Japan 
technical report '91 -valve flow coefficient-1 reference) using the state-transition model etc. is known. 
[0004] 

[Problem(s) to be Solved by the Invention] However, the above-mentioned conventional composition (1) and (2) have the - 
following troubles, respectively. 

[0005] First, it is the composition of creating the map to the sensibility word which reflects a user's subjectivity scale from the 
color feature which a picture has based on a sample picture, and referring to the equipment of the above (1) by inputting this 
sensibihty word at the time of reference. For this reason, while choosing and using a sample picture suitable at the time of map 
creation, since a sensibility word is subjective, it is lacking in versatility, and it has the trouble that adjustment of a map is 
required, by the reference person. 

[0006] Moreover, it has the trouble that it is lacking in versatility since extraction of a keyword is completely dependent on a 
state-transition model, and it cannot refer to the equipment of the above (2) at all to what does not correspond to a model since a 
keyword is not given. Moreover, at the time of reference, it is required for a reference person to input only superordinate 
concepts, such as "soccer", as a keyword, scene description becomes a thing only depending on a model, and a reference person's 
v^ll is not reflected. 

[0007] this invention aims at realizing the high image database equipment of versatility while it was made in view of each 
above-mentioned trouble and can extract the keyword of more advanced conceptual level from a picture automatically at the time 
of registration of a picture. 
[0008] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, the image database equipment of this 
invention according to claim 1 A picture storage means to match a picture with a keyword and to memorize it, and a picture input 
means to input a picture, The picture division means which carries out field division of the input picture, and a picture 
characteristic quantity calculation means to calculate the picture characteristic quantity of each divided field, A scene description 
language conversion means to change picture characteristic quantity into a scene description language, A state-transition model 
storage means to memorize a state-transition model, and a state-transition means to perform processing which makes the state of 
each field change to a high order hierarchy as long as the scene description language of each field suits the changes rule of a 
state-transition model, About the field where the state changed by processing of the above-mentioned state-transition means, 
make the final state of this field into a keyword, and a scene description language is made into a keyword about the field where a 
state did not change. It is characterized by having the registration means made to memorize to the above-mentioned picture 
storage means widi the above-mentioned input picture. 

[0009] Image database equipment according to claim 2 is set to equipment according to claim 1 . A reference demand input 
means by which a reference person inputs a reference demand, and a reference demand analysis means to create the reference 
keyword at the time of analyzing the inputted reference demand and performing reference, While having ftirther a picture 
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reference means to search a picture from a picture storage means according to the above-mentioned reference keyword, and a 
picture presentation means to show the picture of a reference resuh to a reference person When the above-mentioned reference 
demand analysis means is in the state where the inputted reference demand exists in a state-transition model While a changes rule 
is gone back from this state and this state and the above-mentioned picture reference means is passed by making into a reference 
keyword all the states that can reach When the inputted reference demand does not exist as a state in a state-transition model, it is 
characterized by passing the above-mentioned picture reference means by making into a reference keyword the scene description 
language which the reference person was made to input a scene description language as a reference demand by the reference 
demand input means, and was inputted. 

[0010] In equipment according to claim 1, image database equipment according to claim 3 is characterized by the 
above-mentioned registration means making it memorize to die above-mentioned picture storage means by making the 
above-mentioned positional information into a keyword about the field where the state changed by processing of a 
state-transition means in addition to the above-mentioned final state while a scene description language contains the positional 
information which shows the position of each field in an input picture. 

[001 1] Image database equipment according to claim 4 is set to equipment according to claim 2. In case the above-mentioned 
picture reference means searches a picture according to a reference keyword, when a reference keyword is in the state in a 
state-transition model While giving a score to the picture which has a reference keyword and a keyword in agreement according 
to the hierarchy in the state-transition model of this state, when a reference keyword is a scene description language The scene 
description language in which it moves and the state of the least-significant hierarchy of the state-transition model which can 
reach has the keyword of the picture memorized by the picture storage means to a changes rule, The scene description language 
as the above-mentioned reference keyword is compared, and while giving a score to the picture memorized by the 
above-mentioned picture storage means according to the degree of coincidence, the above-mentioned picture presentation means 
is characterized by showing the picture to which the score higher than a predetermined score was given as a reference result. 
[0012] 

[Function] According to composition according to claim 1, the picture characteristic quantity calculated from each field of the 
divided input picture is changed into a scene description language. As long as the scene description language of each field suits 
the changes mle of a state-transition model, the fmal state of the field about the field where the state of each field changed [ in ] 
to the superordinate concept, and the state changed as a keyword Moreover, about the field where a state did not change, the 
scene description language of the field is memorized by the picture storage means with an input picture as a keyword. 
[0013] Since a scene description language is automatically given as a keyword and is memorized by the picture storage means 
also to the picture which has by this the concept which does not suit a state-transition model Since a registrant does not need to 
give a keyword in case a picture is registered, while becoming possible to mitigate a registrant's work burden, if a scene 
description language is given as a keyword, the above-mentioned picture can be searched at the. time of reference. That is, 
flexible reference is attained, while the versatility of image database equipment inproves, since the kind of picture in which 
storage and reference are possible is not limited with the state-transition model which image database equipment holds. 
[0014] When the reference demand which the reference person inputted exists as a state in the state-transition model which 
image database equipment holds according to composition according to claim 2 A changes rule is gone back from this state and 
the above-mentioned state, all the states of the low rank hierarchy which can reach A picture reference means is passed as a 
reference keyword, the picture in which a picture reference means has this reference keyword and a keyword in agreement is 
searched from a picture storage means, and the reference result is shown to a reference person. On the other hand, when the 
reference demand which the reference person inputted does not exist as a state in the state- transition model which image database 
equipment holds, the scene description language which the reference person was made to input by the reference input means is 
passed to a picture reference means as a reference keyword, and a picture reference means searches a picture according to the 
scene description language passed as a reference keyword. 

[0015] Even if it is the case where reference of the picture which does not suit by this the state-transition model which image 
database equipment holds is required, a scene description language is made to input as a reference demand, and it becomes 
possible to search a picture according to this scene description language. Consequently, it is lost with image database equipment 
that the kind of picture in which storage and reference are possible is limited widi a state-transition model, and it becomes 
possible to raise the versatility of image database equipment. 

[0016] According to composition according to claim 3, about the field where the state changed to the high order hierarchy by 
processing of a state-transition means Since the position in the input picture of the field is registered [ final state / of a field ] with 
an input picture as a keyword In case it searches, when a reference person performs the specification a "person" as a state of a 
"center section" and a field as positional information, it becomes possible to give the conditions of "the picture to which a person 
exists in a center section", and to search a picture. Consequendy, retrieval effectiveness can be raised, while becoming possible 
to search by pointing to the picture image for [ which the reference person is holding ] reference to image database equipment 
more concretely and attaining the flexible reference in which a reference person's volition was reflected. 

[0017] According to composition according to claim 4, the picture searched as a reference keyword the state in a state-transition 
model The picture searched considering the scene description language as a reference keyword by giving such a high score that a 
hierarchy becoming high according to the hierarchy in the state-transition model of the above-mentioned state The scene 
description language which goes back a changes rule from the keyword of the picture memorized by the picture storage means, 
and the state of the least-significant hierarchy of the state-transition model which can reach has, Only the picture to which the 
scene description language as the above-mentioned reference keyword was compared, such a high score that the degree of 
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coincidence becomes high was given to, and the score higher than a predetermined score was given is shown as a reference result 
to a reference person. 

[0018] Since a picture with high possibility of being the picture for which a reference person asks will be shown by this, while 
becoming possible to raise the retrieval effectiveness at die time of a reference person choosing a desired picture from the picture 
shown as a reference result etc., possibility that the picture which was widely different from the picture for which a reference 
person asks will be shown can be decreased, and the reliability of image database equipment can be raised. 
[0019] 

[Exanple] It will be as follows if one example of this invention is explained based on drawing 1 or drawing 6 . As the image 
database equipment in this example is image database equipment with which a color picture is registered and searched and is 
shown in drawing 1 as composition about registration of a picture The image database 1 1 which accumulates a picture and its 
keyword, and the picture input section 1 (picture input means) for inputting the picture registered into a database, The input 
image memory 2 for accumulating the picture inputted from this picture input section 1 , The limited color picture creation 
section 3 (picture division means) which divides the whole picture into two or more fields, and creates a limited color picture 
while inputting the full color picture accumulated at this input image memory 2 and carrying out sub tractive color of the color 
number. The limited color picture memory 4 which accumulates this limited color picture, and the labeling section 5 which 
carries out labeling of the above-mentioned limited color picture, and creates a labeling picture, The labeling picture memory 6 
which accumulates a labeling picture, and the picture characteristic quantity calculation section 7 (picture characteristic quantity 
calculation means) which calculates the picture characteristic quantity of each field, The scene description language transducer 8 
(scene description language conversion means) which changes picture characteristic quantity into a scene description language, 
The state-transition model database 9 (state-transition model storage means) which accumulated the rule for the state of each 
above-mentioned field changing, It has the state- transition section 10 (state-transition means) which makes the state of each field 
change, referring to this state-transition model database 9, and the data registration section 1 2 (registration means) which 
registers the input picture of the input image memory 2 to the above-mentioned image database 1 1 with a keyword. 
[0020] Here, a state-transition model is explained. It is a model for bringing more the state of the segment which serves as a 
state-transition model from a state transition diagram as shown in drawing 6 , and a changes mle, and mentions later operation in 
which a state will change to a high order hierarchy as an arrow shows if the changes rule in this drawing set [ in / states, such as 
"Human" and "Human-hair", / for example ] up beforehand is filled by repeating as long as the changes rule filled exists close to 
a superordinate concept. 

[0021] Here, registration of the color picture by the above-mentioned composition is explained below, referring to the flow chart 
shown in drawing 2 . In addition, in this example, the color picture registered presupposes that each element of (Red R), (Green 
G), and blue (B) is the full color picture expressed by the 8 bits (256 gradation from 0 to 255) digital data, respectively. 
[0022] First, the color picture which it is going to register into an image database is inputted by the picture input section4, and is 
accumulated at the input image memory 2 (it writes like SI Step I and the following). 

[0023] Next, although a body etc. is recognized from this input picture, it is necessary to cut down first the body which serves as 
a candidate for recognition from a picture for this recognition. Here, since an input picture is a full color picture, it uses the 
technique of the color segmentation which extracts the field constituted by the same color. That is, create the limited color 
picture which limited the color to about 16 colors from the full color input picture which the limited color picture creation 
section 3 took out from the input image memory 2 (S2), and the labeling section 5 sets in the limited color picture created by the 
above S2. The same label is given to the connection field of the same color, and a picture is divided into two or more fields by 
making into one connection field the field which has the same label (S3). Henceforth, suppose that each of these divided fields is 
called segment, 

[0024] Next, the picture characteristic quantity calculation section 7 computes picture characteristic quantity, such as the pulse 
duty factor and circularity to area, a circumscription rectangle, a color, the direction of a main shaft, and the direction of a main 
shaft, and the center of gravity, about each segment, respectively, and (S4) and the scene description language transducer 8 
create the scene description language of each segment from the confuted picture characteristic quantity (S5). in addition, this 
scene description language is in every direction in the size of a segment, and the whole input picture ~ when it trichotomizes, 
respectively and divides into nine blocks, it consists of two or more kinds of parameters which express the block position where 
an applicable segment is contained, the color of a segment, the configuration of a segment, and the direction of a main shaft of a 
segment, respectively 

[0025] In S6 continuing, the state- transition section 10 does as follows the work which determines the concept of each segment 
based on the scene description language of each segment, and the state-transition model accumulated at the state-transition model 
database 9. 

[0026] That is, the state-transition section 10 will make the state of this segment change to the hierarchy on one, if it investigates 
whether the scene description language created by the above S5 to each segment is filling the changes rule of a state-transition 
model sequentially from the subordinate concept of a state-transition model and the changes rule is filled. 
[0027] A state-transition model as shown in drawing 6 is more specifically given, and if the parameter which shows the color of 
the segment in the scene description language of a certain segment is "black", this segment will fill the changes rule, will change 
to 1 hierarchy high order from "Color-segment" which is the concept of the least significant, and will serve as "Black-segment." 
Furthermore, when the scene description language of this segment fulfills the conditions which may be the picture of human 
being's hair portion, it means that the changes rule was filled further and changes to 1 hierarchy high order to a pan. Thereby, this 
segment is recognized as a segment which has conceptual "Human-hair" that it is human being's hair. 
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[0028] To the above-mentioned state-transition model, moreover, for the excessive rate at the time of the field division in S3, 
shading, etc. Since what is originally one body corresponds to the body divided into two or more segments, the body which 
consists of two or more colors Comparatively, the changes rule as a field integrated mle which performs only integration of 
segments, without making a state change in the hierarchy of a high order is also contained, the segments which fill this field 
integrated rule are unified, and they are recognized as a segment which has one new concept. 

[0029] As a segment which a state-transition model as shown in drawing 6 is more specifically given, and is contained in an 
input picture When the segment which has above-mentioned conceptual "Human-hair", and the segment which has conceptual 
"Human-skin" that it is the picture of human being's skin portion exist These segments are unified as what fills a field integrated 
rule, and are recognized as one segment which has conceptual "Human- face" that it is the picture of human being's face portion. 
[0030] After it is repeated until no state of the segments in an input picture stops changing, and this operation is completed, the 
data registration section 12 registers operation of Sabove-mentioned 6 into an image database 1 1 with the picture inputted by the 
above SI by making into a keyword concepts, such as the fmal state called for by the above S6 fi:om each segment, i.e., 
above-mentioned "Human-face" etc., (S7). In addition, about the segment which changed to the concept of a high order rather 
than the predetermined hierarchy, the positional parameter of a scene description language is also registered with the 
above-mentioned keyword to an image database 1 1 at this time. Moreover, about the segment to which a state did not change at 
all in the above S6, a scene description language is registered as a keyword. 

[0031] In addition, with the above-mentioned state-transition model, on the low rank hierarchy of a state-transition model, the 
importance of a scene description language becomes low, and the field integrated rule is set up so that segments may be unified 
preferentially as inportance is attached to a scene description language, the changes rule is set up so that a state may be made to 
change, and it becomes a high order hierarchy. Thus, on the low rank hierarchy, while raising versatility by making a state 
change by the scene description language, to the high order hierarchy, the reliability of recognition is raised by seldom 
depending on a scene description language, but seeing the relation between segments etc. globally, and performing a state 
transition. 

[0032] In addition, here explains creation of the limited color picture in the above S2 in more detail based on the flow chart 
shown in drawing 3 . 

[0033] First, the limited color picture creation section 3 creates the histogram of a full color input picture (S21). Since each of 
R-G-B is expressed by 256 gradation, each color in a picture is expressed with this example as a point of a RGB sky throughout 
which is among the cube of 256 (from 0 to 255) one side. It divides into the cube of the this 1 called cell in the cube of 256 one 
side side 8. Next, the RGB value of the pixel in a picture is calculated, it asks for to which cell the pixel belongs all over RGB 
space, and only 1 makes the fi-equency value of the cell to which the pixel belongs increase. This processing is performed to all 
pixels and a histogram is created. 

[0034] Next, the mode cell which is a cell with the largest fi-equency value is detected in the created histogram (S22)- thexolor ^ 
which this mode cell expresses is made iiito a representation color, and the color of the cell contained in the sphere of the radius 
to which this mode cell is beforehand given as a center is replaced in the above-mentioned representation color. Thus, the cell as 
which the color was determined is excepted fi-om an object, and it returns to S22, and the same processing is repeated until an 
object cell is lost. Subtractive color of the color number of a ftill color picture can be carried out to about 16 colors by making 
the above-mentioned radius at the time of performing these processings adjust suitably. That is, when there is little color number, 
the above-mentioned radius can be made small, the number of the cells which can be expressed with one representation color by 
enlarging the above-mentioned radius in many can be adjusted, and the color number can be brought close to the number of 
hope. 

[0035] Next, it explains, referring to drawing 4 and drawing 5 about reference operation of the picture by the composition v^th 
which the image database equipment of this example is equipped, and this composition, in order that a reference person may 
search a picture from the image database 1 1 into which the picture is registered with the keyword, as explained above. 
[0036] Further in addition to the composition about registration of the picture mentioned above, as shown in drawing 4 , the 
image database equipment of this example The reference demand input section 2 1 (reference demand input means) for the 
reference person who searches inputting a reference demand, The reference demand analysis section 22 (reference demand 
analysis means) which analyzes the inputted reference demand, It is the composition equipped with the reference section 23 
(picture reference means) which searches the picture which corresponds based on the analysis result of a reference demand from 
an image database 11, and the picture presentation section 24 (picture presentation means) which shows a reference person the 
picture searched by the reference section 23. 

[0037] In the above-mentioned composition, in searching the picture accumulated at the image database 1 1, a reference person 
inputs fu-st the name of the structure which constitutes the picture to search by the reference demand input section 2 1 as a 
reference demand (SI 1). When it explains more concretely and a reference person, for example, wants to search a picture 
including the person, it is "Human" as a name of a structure. It will input. 

[0038] If a reference demand is inputted, the reference demand analysis section 22 v^ll look for the state-transition model 
database 9. The concept which is in agreement v^dth the name of the structure inputted as a reference demand by SI 1 If contained 
in the state-transition model accumulated at the state-transition model database 9 (SI 2), it will return to SI 1 and the reference 
demand input section 21 will direct to input the reference demand about the position of the above-mentioned structure in a 
picture to a reference person. 

[0039] Thereby, a reference person becomes possible [ creating a reference demand, such as "a picture in which a person is right 
in the middle", ]. Consequently, while becoming possible to search by pointing to the picture image for [ which the reference 
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person is holding ] reference to image database equipment more concretely and attaining the flexible reference reflecting a 
reference person's will, the effect that retrieval effectiveness inproves is done so. However, a reference person does not 
necessarily need to follow the above-mentioned directions, and can also progress to SI 3 which is the following step, without 
inputting the reference demand about a position. 

[0040] If the concept which is in agreement with the name of the structure inputted as a reference demand on the other hand does 
not exist in the state-transition model accumulated at the state-transition model database 9 (SI 2), it returns to SI 1 and the 
reference demand input section 21 makes a reference person input the reference demand by the scene description language. In 
addition, as described above as the scene description language, it is the position to a size and the whole input picture, the color, 
the configuration, and the direction of a main shaft of an object. However, it is not necessary to input these [ all ] as a reference 
demand. 

[0041] Thus, when the position or a desired concept does not exist in a state-transition model if needed [ the concept and if 
needed ] which exist in a state-transition model, a scene description language is passed to the reference section 23 as a reference 
demand. In addition, the above SI 1 and S12 is repeated until a reference person ends creation of all reference demands (SI 3). 
[0042] In addition, the user interface in the reference demand input section 21 for a reference person inputting a reference 
demand For example, if the concept included in the state-transition model in the menu screen by GUI (Graphical User Interface) 
is displayed as an icon and a reference person chooses a desired thing from these icons According to [ the concept corresponding 
to the selected icon is able to be passed to the reference section 23 as a reference demand, and ] this, the operability for a 
reference person can be raised. Moreover, when the concept corresponding to the structure of a request of a reference person is 
not displayed as an icon (i.e., when the desired concept is not included in a state-transition model), it can also be directed to 
make various kinds of parameters of a scene description language input in the pictures. 

[0043] The reference section 23 searches the picture which corresponds from an image database 1 1 based on the 
above-mentioned reference demand (SI 4), and the picture presentation section 24 presents the reference result of the reference 
section 23 to a reference person (SI 5). 

[0044] Here, the above-mentioned reference operation is explained more to a detail using the example of the state-transition 
model shown in drawing 6 . 

[0045] The reference demand analysis section 22 performs processing which is different whether the inputted reference demand 
is the concept which exists in a state- transition model, or it is a scene description language. Processing when the concept which 
exists in a state-transition model is first inputted as a reference demand is explained. Here, it is name "Human" of a structure by 
the reference person. As it is inputted as a reference demand and shown in drawing 6 , it is "Human" to a state-transition model. 
Suppose that it exists as a concept. 

[0046] When existing in a state-transition model judges the above-mentioned reference demand in the analysis of the reference 
demand analysis section 22, the reference demand anajysis section 22 is this reference demand "Human". It considers as a_ 
reference keyword, and passes to the reference section 23, and the reference section 23 searches an image database 1 1 based on 
this reference keyword. If the picture whose "Human" is a keyword is registered into the image database 1 1 as a result of search, 
let this picture be a candidate picture, furthermore, the reference demand analysis section 22 — the above-mentioned 
state-transition model - setting — "Human" from — when the picture which has the keyword which corresponds with this 
reference keyword searches and exists [ whether it registers with the image database 1 1 , and ], the score according to the 
hierarchy of this "Human-face" gives [ pass / the reference section 23 / by making into a reference keyword "Human-face" which 
is the concept which got down only from one hierarchy to the low rank ] by making this picture into a candidate picture In 
addition, the above-mentioned score is given according to the hierarchy of a state-transition model, and a high score is given, so 
that the hierarchy of a high order is approached. 

[0047] After performing grant of the search and the score by the above reference keywords one by one to the hierarchy of the 
least significant of a state-transition model, the picture which has a bigger score than the threshold beforehand set up among the 
candidate picture and the picture which became is presented by the picture presentation section 24 as a picture of a reference 
result to a reference person. Moreover, when there are two or more kinds of reference demands, the picture to which the average 
of the score to all reference demands became larger than the above-mentioned threshold among the candidate picture and the 
picture which became is shown as a reference result. 

[0048] Next, processing when the inputted reference demand is a scene description language is explained. Here, suppose that the 
state-transition model shown in drawing 6 is used, 

[0049] In this case, the reference demand analysis section 22 is passed to the reference section 23 by making the inputted scene 
description language into a reference keyword. Next, what is registered into the image database 11 as a keyword of a registration 
picture among the concepts in the state-transition model of the state- transition model database 9 is chosen from a state- transition 
model. That is, if only "Human-face" shall be registered into the image database 1 1 with the picture as a keyword among the 
concepts which exist in the state-transition model shown, for example in drawing 6 , this "Human-face" will be chosen. 
[0050] And the reference section 23 performs comparison with the scene description language given as a reference demand in 
the concept of the least-significant hierarchy which reaches by going back a changes rule from "Human- face" to a low rank 
hierarchy. The changes rule in the low rank hierarchy of a state-transition model in more detail Each parameter of the scene 
description language which is given as power conditions which each parameter of a scene description language fulfills, and was 
given as a reference demand. The score as a candidate picture is given to the picture by which each parameter of the scene 
description language as the above-mentioned conditions is registered into the image database 1 1 by making above-mentioned 
"Human-face" into a keyword according to whether to be how much in agreement. In addition, the score given shall also become 
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high, so that the degree of coincidence of each above-mentioned parameter is high. 

[0051] As mentioned above, after performing grant of the comparison based on each parameter of a scene description language, 
and a score to all the keywords registered into the image database 1 1, the picture which has a bigger score than the threshold 
beforehand set up among the candidate picture and the picture which became is presented by the picture presentation section 24 
as a picture of a reference result to a reference person. Moreover, when there are two or more kinds of reference demands, the 
pictine with the larger average of the score to all reference demands among a candidate picture and the picture which became 
than the above-mentioned threshold is shown as a reference result. 

[0052] As mentioned above, the image database equipment of this example divides into two or more segments the ftill color 
picture which the picture input section inputted based on a color, and creates a scene description language from the picture 
characteristic quantity conqjuted from each segment. Furthermore, in case the state of each segment is made to change to the 
concept of a high level as much as possible and a picture is registered into an image database by applying a state-transition model 
to this scene description language, the final state of each segment is registered as a keyword with a picture. Moreover, it is the 
conposition of also registering the position of this segment in a picture with the above-mentioned fmal state about the segment 
which changed to the high order hierarchy, and registering a scene description language about the segment to which the changes 
to a high order hierarchy were not performed at this time. 

[0053] Since an objective keyword is given ** [ according to / a registrant's subjectivity ] while the work burden of the registrant 
at the time of creation of an image database is sharply reducible, since the work which a registrant gives a keyword becomes 
unnecessary by this to each of the picture to register, the effect that the versatility and reliability of an image database can be 
raised is done so. 

[0054] moreover, when searching the picture registered by doing in this way and the concept which exists in a state-transition 
model is given as a reference demand It searches for whether while searching an image database by making this concept into a 
keyword, the picture which made the keyword the subordinate concept in the changes rule which reaches to the above-mentioned 
concept is registered into the image database one by one to a least-significant concept. When the picture is registered, the score 
according to the hierarchy in the state-transition model of the concept as a keyword of the picture is given to the 
above-mentioned picture, and has composition shown to a reference person by making only a picture with this larger score than a 
predetermined threshold into a reference result. 

[0055] Even when the concept as a reference demand which the reference person gave is not registered as a keyword by this, it is 
possible to raise possibility that the picture in which a reference person asks for the concept of the low rank hierarchy of the 
concept since it will be shown as a reference result if there is a picture registered as a keyword will be shown as a reference 
result. Consequently, the effect that the flexible reference based on the more abstract advanced concept is attained is done so. 
Moreover, it prevents that the picture for which a reference person asks, and the picture which was widely different are shown 
since only a picture with a larger score than a predetermined threshold is shown, and while a reference person becomes possible 
mitigating the burden which chooses a desired picture ], the reliability of an image database can be raised. 
[0056] moreover, about the segment to which a state did not change with the state-transition model which this image database 
equipment holds in the case of registration of a picture A scene description language is registered with a picture as a keyword, in 
the case of reference When the concept which does not exist in the state-transition model which this image database equipment 
holds is given by the reference person as a reference demand While giving a reference person directions so that a reference 
demand on scene description language level may be inputted The changes rule in the concept of the least-significant hierarchy 
which can reach by going back a changes rule from the concept registered into the image database as a keyword. It is the 
composition that compare each parameter with the scene description language inputted by the reference person as a reference 
demand, give a score to the picture registered corresponding to the above-mentioned keyword according to the degree of 
coincidence, and this score presents only a larger picture than a predetermined threshold as a reference result. 
[0057] The effect that an image database can raise the versatility of an image database only depending on a state-transition 
model also about the picture which has the concept which does not exist in the state-transition model which this image database 
equipment holds by this since it becomes possible to perform registration and reference by using a scene description language is 
done so. 

[0058] In addition, although this invention is not limited to the above-mentioned exan^^le and this example explained the kind of 
parameter of a scene description language as the size, the position, the color, the configuration, and the direction of a main shaft 
of a segment, it is also possible to make other elements into a scene description language according to the kind of picture 
registered into a database. Moreover, according to the use purpose of the kind of picture, or a database to register, various 
models are applicable also about a state-transition model, 
[0059] 

[Effect of the Invention] As mentioned above, the image database equipment of this invention according to claim 1 A picture 
storage means to match a picture with a keyword and to memorize it, and a picture input means to input a picture. The picture 
division means which carries out field division of the input picture, and a picture characteristic quantity calculation means to 
calculate the picture characteristic quantity of each divided field, A scene description language conversion means to change 
picture characteristic quantity into a scene description language, A state-transition model storage means to memorize a 
state-transition model, and a state-transition means to perform processing which makes the state of each field change to a high 
order hierarchy as long as the scene description language of each field suits the changes rule of a state-transition model. It is 
conqjosition equipped with the registration means which makes the final state of this field a keyword about the field where the 
state changed by processing of the above-mentioned state-transition means, and is made to memorize to the above-mentioned 
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picture storage means with the above-mentioned input picture by making a scene description language into a kejword about the 
field where a state did not change. 

[0060] Since the kind of picture in which storage and reference are possible is not limited with the state-transition model which 
image database equipment holds while becoming possible to mitigate a registrant's work burden, since a scene description 
language is automatically given as a keyword also to the picture which has by this the concept which does not suit a 
state-transition model, the effect that the versatility of image database equipment improves does so. 

[0061] A reference demand input means by which, as for image database equipment according to claim 2, a reference person 
inputs a reference demand, A reference demand analysis means to create the reference keyword at the time of analyzing the 
inputted reference demand and performing reference, While having further a picture reference means to search a picture from a 
picture storage means according to the above-mentioned reference keyword, and a picture presentation means to show the picture 
of a reference result to a reference person When the above-mentioned reference demand analysis means is in the state where the 
inputted reference demand exists in a state-transition model While a changes rule is gone back from this state and this state and 
the above-mentioned picture reference means is passed by making into a reference keyword all the states that can reach When the 
inputted reference demand does not exist as a state in a state-transition model, it is the composition passed to the 
above-mentioned picture reference means by making into a reference keyword the scene description language which the 
reference person was made to input a scene description language as a reference demand by the reference demand input means, 
and was inputted. 

[0062] Even if it is the case where reference of the picture which does not suit by this the state-transition model which image 
database equipment holds is required, it becomes possible to make a scene description language input as a reference demand, and 
to search a picture. Consequently, while it is lost with image database equipment that the kind of picture in which storage and 
reference are possible is limited with a state-transition model and more flexible reference is attained, the effect of becoming 
possible to raise the versatility of image database equipment is done so. 

[0063] Image database equipment according to claim 3 is composition which the above-mentioned registration means makes 
memorize to the above-mentioned picture storage means by making the above-mentioned positional information into a keyword 
about the field where the state changed by processing of a state-transition means in addition to the above-mentioned fmal state 
while a scene description language contains the positional information which shows the position of each field in an input picture. 
[0064] Since this is enabled to input the body contained in a picture as a reference demand with the position, it becomes possible 
to search by pointing to the picture image for [ which the reference person is holding ] reference to image database equipment 
more concretely. Consequently, it depends reflecting a reference person's will, flexible reference is attained, and the effect that 
retrieval effectiveness can be raised is done so. 

[0065] In case the above-mentioned picture reference means searches a picture according to a reference keyword, when a 
reference keyword is in the state in a state-transition model, image database equipment according to claim 4 While giving a score 
to the picture which has a reference keyword and a keyword in agreement according to the hierarchy in the state-transition model 
of this state, when a reference keyword is a scene description language The scene description language in which it moves and the 
state of the least-significant hierarchy of the state-transition model which can reach has the keyword of the picture memorized by 
the picture storage means to a changes rule. While giving a score to the picture which compares the scene description language 
as the above-mentioned reference keyword, and is memorized by the above-mentioned picture storage means according to the 
degree of coincidence, the above-mentioned picture presentation means is the composition of showing the picture to which the 
score higher than a predetermined score was given as a reference result. 

[0066] Since a picture with high possibility of being the picture for which a reference person asks is shown by this While 
becoming possible to raise the retrieval effectiveness at the time of a reference person choosing a desired picture from the picture 
shown as a reference result etc. Since possibility that the picture which was widely different from the picture for which a 
reference person asks v^ll be shown decreases, while a reference person can mitigate the burden which chooses a desired picture, 
the effect that the reliability of image database equipment can be raised is done so. 



[Translation done.] 



7 of 7 



9/24/031:28 PM 



mB^m<t^m <jp) 02> i& ^ J|# |^ ^ ^ (a) (ummim^iimm^ 

#W¥8- 249349 

(5i)intci.» mmn fftni^mn fi 

G0 6F 17/30 9194 - 5L G0 6F 15/40 3 7 OB 

9194-5L 15/401 3 1 OA 



m^m^ 4 OL (^11 s) 



(21)01^^ 


WHT7 -54794 


(71)aHA 


595037261 










«rt IE* 




(22) WHS 


3pfS7#(1995)3^14B 




w^)\\mmmm^&mvii^B:2 -56- 


7 






(71) USA 


000005049 




















:*:IRJfl:*:EmSIfSfSPKSffii»r22S22# 










Srt IE* 










»«;t|»«Srfr»IIIKIIU*«fi2 -56- 


7 




































(74) A 


#1!± M aiH 





(54) C^M<7>«i»] B«5^-^^^-XSB 



(57) 

1 1 ^^^-f^o 



1 0 



1 

xit^i^mt^ hm^/i^-/i^^mr7i^xmm'^m^j:ikm'r^ 
x^^m^-9- Kt.\^x±.mm^mm^^^M-r-~ . 

^t^—iyt^^mm^^m^^tvx^^ti^-^. p^ti^iri 
tziy-i^mmnm^mm^-'::^— \' t \^x±t^m^^m 

t^. i(^mm^^^<Dmm\c^^xikmi>m^i^r:L^m\z 
h't^i^-^^u^mmxh^m'^^zit. m^u^^m^u 

tg^nri^-SMffeco^ — !7— K^^bM^/i-— /^^i^^TL 
i^->m^mmt. h^tvx(Di^-> 
mi^mzum^ixx\.-^^mm\zm^^^n^'r^t^{z.. 



(2) 4#pifl8- 2 4 9 3 4 9 

t 0 0 0 1 1 

^-u-¥^^K.^z.t\cx-^xm^(oi^^.^rfo 

[0 0 0 2 ] 

'r^m^tmm^fi^m^'f-^-<-::^'^m.t^^h^x 
-r^x(nmm^n\^x^m^t^^-'y-\'^^ 

[0 0 0 3 ] Z.(D^of^m.^t\^X. ^'Jx.(^. (1) ^ 
fz.m^mm\ : *[f #^S^^I^3tli, Vol. 31, no. 2 (199 

0) #P) , ( 2 ) t^^M^^7^/^'^>ffiV^fc[1^^7^"^ 

: mn^mm^^Wi '9i-cv-73-i#0a) m^)^ 

[0004] 

tz^i!^^(Dmf& (1) *5J:U^ (2) TB<^X^^£?^m 
[0 0 0 5 ] ^-f. ±IS (1) c7)SSr-ii, M^O^^o 

-fe^ta b f ijffl # o s * ?*-r s iistt i§ ^ ^® 

[0 0 0 6] ^fc. ±fB (2) O^gr-li, ^-17" K 
ffi d^^^ ^iS^^T^/Kc b ri S 7t *!? fc ^ 

50 [0 0 0 7] ^^mn±,u\^f^^?^^Mj^Az.^^^j:^riti 



(3) 

3 

[0 0 0 8] 

[0 0 0 9] if>jttg2fa^(?^iii«^T^--^-<-^i^lii^. 
[0010] m^^3um(Dmm'f-<^^-:^mw:n. 

[0011] ff^3ri4l5^0M«v"->?^-<";^i^§li, 

^—9—¥\zv^^xm^^^m'r^mz.. 
¥t-i^mm^=^'f;i^^<Dij^mx'hhm'k\z.\'t. ^v^m<o 



it^^ijis- 2 4 9 3 4 9 
C T JifECO lij felEtt IB^ ^ i^r 1/ ^ ^ M) ^ #^ ^ 

[0012] 

[#ffl] fS3ftJIiIB«co«j^fe{cJ:ni^, ^I'l^tbfcA;':? 

imt^m^\^fz.m.mz.-:>y^^x\^^(Dm^ 

o fc^^ o 1/ ^ r ^ <7>^^ — >- HSizi^-ii f§ ^ " 

- Yt L.xx^mm.tmz.m^m*&^mz,um.^^^o 

[0 0 13] rntcj:!?. t^Mi^^^v^'/i^t-jl'^U?'.^"'^ 

— UT^x._nji*JilSM^(?:>^^^tT o z. tt^x 
-r?^^^:?'^. late • ^^;&^"^tg/.tiiji(^aiS^^®^ 

[0 0 1 4 ] if3itii2fBaco«^{cj:ni^. i^mmt-x 
mmm^^y'^i^^\z.m^t\^x^i£'r^m%\z\^. :L<Di^ 
^mm<7^^m(D'r-^x tt^. ^m^-v-Y ti.xm^ 

ti^xm^mm^^^m^th. m 
^mm^^\t. ^m^-^-Yti.xm^f^f—y-^'t^ 

[0 0 15] ci^^cJ: 19. mm'f-i^^-^^mmit-^n 
i.x\^^^ii^mm^'^'T/i^\cm^ L/.ei^M^<^^^>&^^^ 

xAti^-^. z.<Di^—i^ui^^m^z^ii^^xmm<D^m^ 



5 

(0 0 16] m^^3um<omf&\cxti\t. ^mm^^ 

T% mm^rfom\z,. ^m^tmm:mnti.xmx.ii: 

t^^-^o^i^^^^xmrn^mm-Thztt^-^mt^j^^o 
z.<D^^. ^m^iim\^^x\.^^^mM^<om^^ 

[0 0 17] is^ii4ia^o«jS{cj:mi, ^mm^=e 

[0018] z.i%\z.x ^ . mm^it^mm-r^m^x^^ 
tmmm^t i.xm7r^^titzmm.^'hmm<Dm^^mtfi 

[0019] 

immm] :^mm<D~mmm\^^^'^xm i z^^^Lne 
&-^\^^xmm-rti\'£. j[^roii(9 r-^So ^mMmi^:is 

-r^mm'f—^^—:^mw:xh^. mm^^m^m-r^ 

*c#SS^tifc7/u;^7^-iliS^A:^b. ^(D^m^m^^ 

i.fj:t^hm^^i^^m^(7ymmz'j^m\^x^^^^m^^ 



(4) 4#iS¥8- 2 4 9 3 4 9 

a 

>^9 (^^M5^^v=^/HBlt#m) 

yUT^- ^ 9 ?r # BS b b <Di^ ^ 

-t^:-5«^M^^i 0 (^^^S^^^) ^, A;'J^ii^fep^^ 

^ 1 i--s^-r67='-^^^^^i 2 (^&^^) t^m 

JO x.ri^5o 

[0 0 2 0 ] err-. ikmm^'e'f/u\z^\,^xmm'r 

'r^m^m^m'rz.t\z.x-:>x. ^ikm-r^^i^:>^> h<D 
[0 0 2 1 ] rrr% ±.u<Dmmz.x^:^'7-m^<D^ 

;^^-Lij^t^. 5^ (R) (G) ■* (B) o^^^ 

i}^^th^thH\i^y h (0;&^ib 2 5 5 ^T'C7>2 5 6P^P) 

<!r-rSo 

[0 0 2 2] ^-r> M^v=^-^5^-<":^tc^^Ui: 9 i:■r 
5;^7^-^i^^:&^ti^^A*^ 1 ^x^^^xAt^n^ 
^^li 2{c#^^ixS (>^xiy^i , ^^T. S\(OXo 

ji? [0 0 2 3] ^ktc, z.(D?.^m^t-hmw^^u^'r^ 

^O^^fe$rffii.^-5o 0^19, PI^^M®^/*^ 3 A 
;^M^^^y 2;6-iblJ'9aiLfc:7/U;^7^-(7>A;'3lij^5^f^ 
1 e-fe^atC-fe^PS^by^cPS^feMS^fF^iJcU (S 
2) , ^-^yv-^^SiS^ ±IES 2T4^i^)t^ilfcPS^& 

M^fc^oi^T, n~'^<o^^^^mz^n\.xm—<Dy^j^ 

[0 0 2 4 ] liI^4#1Sfith^^7;&^, ^-^^^^ 

ix^aiU (S4) . V— >15i&-irfi^^^8id-, ^tH^ 

f^m-rS (S5) o ^<^i5, CCOv'">'lSiK&"^fit:i> 
5(? ^>'hco:^#^, A^»M^^f^^S£«l^ix^'tt3»l'JL 



[0 0 2 5 ] s erMi:, ^^^i^^aii ot^. 

[0 0 2 6 ] -r^jiio-h. ^mm^^i o\^. 

h {CM ur ±ia s 5 r*f^j^ ^ titz. ^m^n^:^^^^ 

[0 0 2 7 ] ^W^\Z.\t. 12 6 J: 5 Z^^^MiS 

hf^'O . :^TteoS^T*^5 "Color-segmented^ tp 1 I® 
/i_bte--M^Ur "Black-segment'^ ^'.^ So ^bS^, C 

t^HMr*^ S ^ I 8E:g:"Huraan-hair'^?fi-t- S 
[0 0 2 8 ] ±tSO^^^®^^T^/u{Cl^, S3{C 

[0 0 2 9 ] ^'o^wmz.\t. ^^\z.m't^bf^^^m 

br, ±|5c7>ta.^'Huiiian-hair'^^-r5-^^^ V h ^ . 
APflc^mtR^OM^r-*>S ^ 5 ta:g:'Huraan-skin"^^ 

m<DmW;^<Dmil^X'^h 1 1/^ ^a^gt'Human-face'^^-r 

[0 0 3 0] iiELfcs 6<oi&f^(i, A^m^^<o-r^ 
h(cMLr±fHS 6r•5^^^^)bi^7t^^t^^, f 

^J^io-^ fi^'J X. 1^ ±fa CO 'Human-face'^ CO ^ — — K 
^Ur, JiISS 1 r-A;^^ixfcM^i:^(cMfe7^"^-^ 

— ^ 1 wc^m-r^ (s 7) o ?'<^:fe> mm<^ 



(5) 4^^¥8- 2 4 9 3 4 9 

8 

c^^titli^'r — ^ 1 l^^^^ixSo ± 

So 

[0 0 3 1 ] /.^iiB. iifSL7t*^^i®^^7=^/l-rM^, 

-g-yU"/u;d^^^^iLTi^So ^oj: 9^cLrTtti5fiir• 
l^^;/">'Ia^l!#fi^cJ: IP^^ffi^iS^^-tirSr iricj: 19^ 
ffltt^i^i^>s-:3^, ±tti5ggTM^v— ^-leia^-i-Mtcfci 

[0 0 3 2 ] r^T% JilBS 2{C:fcttS|5I^feM 

r ^ '9f^L<mp^-rSo 

^f? [0 0 3 3] ^-f, ?f^fe]i]«^^J5fe^3fi. 7>'U;^7 7- 
cOA:^®®(^ t ^ V ^ "7 J^^^J^-f ^ (521) o *:|^ 

m^ijrM:^. R • G • ^<n>^f\.^f\.t^2 5 6i5^pT-^m^ 

5 6 (Od>ib 2 5 5) (7>i:::tr^2f:4^(7>^^ LT^^nSo 
CO— is 2 5 6 

d^>, ^oM9^d^RGB^r^4^T'^<7>-fev'i-{C^-rS:e?^^5jt 
^6r. ^co®9g(7:>M-r S-t/KOiggM^ i/ctt*i;*JD^-ti: 

j(? i.^f^^-rSo 

[0 0 3 4] #;S:^ix/ct h^^i^*T% :gt> 

«SM(?5::^#^^"^/^t-^S^®fi|-^>'^^«tbb (S2 

Lr^*i>-^x.ibtirt-^s*^(/>^F^{c^ 
^ns-t/Kofe^JiIB^-t^-fer-m^^x.So 
•feid^^^^ilfc^yu^M^d^ibl^iSI'Ur s 2 2-^jlD , 
f^^(7>M^^3)^f^-&>'i-;6^?'.^ < ^teS^r-^tJig-To cixb 
oMS^tr 5l^(^±ta*^^M^^{cPS^-ii:Sc i:r-:7 

^M<7>^(cia-:5(:^s c tt^r-^ So 
[0 0 3 5 J iktc. J^_b(cm§^Lfci: ^{ciiife:d^^"^7 
" H ^*{c^^^nTi^SM^^7^"^-<--^ 1 1 d^^. 

So 



9 

m^^mnii^—i^^—^ 1 iib^h^m-r^^m^2 3 

[0 0 3 7 ] iiso^^tcioi^r. m^y"-^^-:^! 

(s 1 1) o x^McWmiz^mm-r^t. m:t\t. ikmm 

LT'Huinan* t P^tl-t ^ :z t 

[0 0 3 8] ^mm^t^p<:^^ti^t. ^mm^m^n 
2 2tmMM^'^y'/i-^—<^^-:^9^mmi^. sii 
xmm^^t i.xp^:^^tifzmmm<?y^^^t-^-rhm. 

^mmm^'ey'/u\z^^tixi^^\^ (S12) . sikc 
i^xm^-r^o 

I 0 0 3 9 ] z.fi\z.x ^ .-^m^\t..-mx.\'£ rS4^{cA 

-^mtfj:^. ^<D^m. mm^t^m^^x\.^^^mMm<D 

t}'^'r\c»i(o:^7' ^y':fX^^S 1 Z^Mt^C ti>X^ 
[0 0 4 0] -:fer, i^mm^t LXA^^tifzmf^^<D 

wm^nx\^^^^mm^'ey'Mz^tE\^^i:\f^it (si 
2) , s 1 i^m^ . mm^^:^ti^2 i^^ v—i^-ie 

->td.mMmt\t. mui^tzxo\z. Mmm<DX^^. 

xhh. tcfzx^. tkmm^ti^x ::.Jthh-r-<xi:P<:^'r 

[0 0 4 1 ] ^(7>J:7tcLr, <^«i^^^v^/Kc#ffi-r 

^WLitt!Z^mzj^^\:^x^<Di<Lm. h^i^n. mm<DWLft. 

S 1 1*5J:U^S 1 2fi, :g|^#;d^-t--<T0^^^5Kc7:># 
f^^^T-r ^^X'^^ iE^iX^ (S 1 3) o 
[0 0 4 2 ] /.t*5, :i^^^;&^:|^^il5}?^A;^-r6fcde><7> 



(6) 4#S^8- 2 4 9 3 4 9 

10 

^'Jx.t^GU I (Graphical User Interface) 5 
7* ^ - M E ( ^ 1 ^ T *c ^ ^ ^ -7^ / K - ^ ^ i^ ri ^ ^ 

^x<Dmrf^^\^}i^-^^^ti)^x^ ^fz. 

[0 0 4 3 1 ^m^2 3 1^, _bffib;t:^^^5R{c£-^i/^ 

14) , mm^^^2 4ibmm'^2 3<r>mmm^^^m 
^--s^-r^ (s 1 5 ) o 

[0 0 4 4 ] c^r-, lil6tc^-rt^^M^^7^/i-co^<j^ 

i-^? [0 0 4 5 ] :t^^g*S?tFf^2 21^. Atl ^ tltzil^m^ 

I ^ - >• IB # fi T- ^ ^ ;6 ^ { ;i J; o T ^ o ^ 3® ^ 

^E-r "5 *lt:f: A ^ n 7t o 1/ ^ -C Hi -r ^ o 

ZZ.X\t. ^m^\ZX^X. «i^S:^O^^v"Hujnan' 

[0 0 4 6] =|^?^^5jtSffr^2 2(7)g?;^tC^l9. ±fECO 

if^mm^m^mm^'e^/i^\z^^-r ^ z. t fi^m^-r^ 
JO t. ^mm^m^'^2 2\t. ^(75^5^^^'Huiiian" 
m^-9-\''ti.xmmn2 3^m\^. ^^9^^231^^ 

(7>:t^^=3e— 17— KtcS-^i/^rM^-r — ^-<":^ 1 l 
m-r^. mm<Dm^. I1j^t^-^-<-;^ 1 KCHuman^ 

^Miii^^-rSo ^bt^. 1^^^^^W^2 2(^, ±fB 

Tt) ?'cta;t:r-^'5*Human-face"$:^^^— 17— bT 
1^^^2 3--®L, 1^^^2 3{^ 

40 i{z^m^tix\^^^f)-wf>-=k^mL. ^it-r^m^nm 

^^^Mfe tX^X ^ CO'Human-f ace'(OPg;i (C^t: Cfc 
< ^i^m%M.i>^^x,hi^^Xo{z/J:-oX\^^^. 

[0 0 4 7] ±U(DX h^\zj:hmmis 
j:m#^.<^fi--^^, ii^mm^'^7'/i^<DmT^<Dmm^X' 
m^^n^tzm. mMm^ttit^fzmmcoi^. ^bd>i:*i> 

^^.g^coM^^ LrM^$i^^2 4{c:J:oT^^#-- 

5i? ^.^^nso ^fc, mmmm<7y^mmm^^^m'^n. 



11 

[0 0 4 8] mz.. p^ti^^tzmmm^iif^iy-^t^^M 
[0 0 4 9] ^(Dm^. ^mm^mmm>2 2\t. a;^^ 

'ey^/i-\Z^^-i'^Wtl^.<D\^^ "Human-f ac e" O 
^—9- bTM^^^fcMS^'x — 1 1 
m^tlX\^^^h<7^t'r^t. Z.<D "Human- face" t^M^ * 

[0 0 5 0] ^Ur, =l^?^^2 3;d^, "Huraan-face'd^b 
_btBO"Human-face"^^— brtlj^T^— ^ 

^-j^ 1 1 (c^^^ixriz-^^M^tci^Lr. ^ItM^^ 

[0 0 5 1 ] ±fS(7>j;5{^. V— ^'tBai-i-fit?^^-^^'^;^ 
;^ 1 1 \z^m^tix\^^^'r^X(D^—9— KJc^brtr 

nx\.^^mmx^^,i^^ti:'^M.^m-r^mmK ikmm 
^(DmiMit vxmmm7T^M2 4{zx<>xmm^^m7^^ 

«<b?:tofcM^(7>F^, 'r-<x<D^m^mcM'r^'<%/^.<D 

[0 0 5 2] Jei±o J: p {c, ;^mMm<Dm§liy^—i^^— 
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[0 0 5 3] CixtCj:!?, ^^-r -SM^CD^^t-MUT 

10 o^^^m-r^. 

[0 0 5 4] ^7t, z.<Dx,o\z,\^x^m^rifz.m^^^ 

^ Mfe - - ^ i^ r 1/ S ^ o ^ ^ 

*T^ic*a:t:^r*M»cffi\ mm^^^^^x\.^^m^\z, 
yt. ^<Dm^<ry^—v—Yt\^x<DWiit<Di^mm^'^^ 

[0 0 5 5 ] ^m^t^^^f'^m^i^tx^ 

^<7:}Wi^^<DT^V^m<^^^^^'^—'y—\^t\.X^^ 

ii^m^<r>mm-r^mm^^mm^t\^x^7y^^H^ 
^m^^'^^^z.tt^^mtti:-^x\^^^. z.<Dmm. X 

^tt>\ifmfht:im^ii^^7T^^i^^^^t^^±\.x. 

[0 0 5 6 ] ^fc, M«<^^^<^l^{^. :^m^'f—^^ 

9-Yt\^xm^tmzmim^t\^. mn<Dm\z.. ^if^m^ 
•7^- " ^ It b r I ^ 5 ^^^i^^ ^ ^ « 
40 \^f^\^^m.^.t^^mm^t x^xi^m^t-h^K. htitzm^ 
{zn. iy—>'U^nmi-'^^^x<Dif^mm^^p^:b-t'^x 

^—9— ¥ t \^x^m^khx\.'^^m.^.fi-hm^j^—j^^ 
^rr-r^z. t\zxKi mm-^m^J:MTi^^^m<Dm^^\z:^if 

SM^/i^-zt-^, mm%{zXK>^m^^t\^XAtl^h. 
50 [0 0 5 7 ] z.ti.izXK>. 7^m^^-^^-:^mm:t^^ 
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[0 0 5 8] ;^mm\t±td.mMm\cm^^ti^h 

*5j:u^±$i;^f^^ LrmB^b/c>d^ 7'->5^-<-;:^tc 

[0 0 5 9 ] 

xtd^^-r^mnkm^^^t. m^^:Kti-r^m^p<ti^ 

m^^^<Dji!im\^x-^xi^mt^m^i^t^mi^^^^^^x\-i 

X. ±up<^mmtmz±ummu^^^^t^^^-^^ 
^m^^t ^m^x\.^^mmx'^^^ 
[0 0 6 0] zti{z.xKf. ikmmm^fj\^{z.m^v^j:^^ 

[0 0 6 1 ] nim.2um<om^'f-^-<-:^'^m^. 
- Y\z.'^-^xmm.w^^^t-hmm.^^n'^ ^m^^m 

bT^^Eb;t(rv^:^'8'(ci^, 
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!7- Ki: bTilf^^i^^fe:gl^#^--s-r«^r-fo^►o 

[0 0 6 2 ] m^^—i^^—:^^^t>^^1^ 
bri^^^K^iS^^T^/K-iS-g* b/^i^M^^^^^^^^^ 

[0 0 6 3 ] ^i^'m.zum(nm^'f-^^-:^^m%. 

^co^S(ci:or^^ffi;d^iS^bfc^iStcoi,^ri:i, ±|S 
[0 0 6 4 ] C^^^cJ:^?, 

i'c? i^m^i^u\i--xy^^^^mn'm.<nm^^ i^—^^'^^'o 

^W^\zM^'f-^-<-:^^m.^^7T^\^X^m^r^b 

[0 0 6 5 ] fi5jtil4_lS«(/51iJ^7='-^5'-<-^^Sj^. 

m^<o^—v— vi)^hw^)\^—)'^^^^\^xnm^^fii 
fi^, '7- F^ brcov-— >faii!-i-fi^^ 

i^^s^^ brs.T^-rs^i^str-^^o 

[0 0 6 6 ] cmcJ:'?, l^^^i^^MfSM^T-^^ 

^ \^x^n^^MzM^t-hm^<om^'^m'^-r^^^<^ 

m.^ii ^ ±1 ^ -ti- ^ c ^ r- # 5 ^ ^ ^ 9 ^ ^ o 
[^c5ofifim?^^l^i^] 

50 D -/ ^ mx'h^o 
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[lie] k.um^'f-^^-::^mw,t^^nir:bm^m^ 
1 m^?-t^% m^A^^m 
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1 1 m^^-^^-:^ (M^IEtS^S) 

1 2 T^-^^^^ 

2 2 (^^^jJ^fi^^Sf^^) 

2 3 1^^^ (Me^l^^^lS:) 
2 4 (Mlfeii;^^^) 
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